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(57)Abstract: 

PURPOSE: To provide a color image pickup device which can estimate the kind and the rate of 
mixing even for mixed lights. 

CONSTITUTION: Chrominance signals rgb are divided into block and average and a color 
difference signal is generated later. Then, a distance calculation part 24 calculates a distance 
between the color difference signal and a previously estimated light source provided from a 
memory 26 on a color difference plane and corresponding to the size of the distance, a reliability 
calculation part 25 calculates reliability as a value expressing possibility to include previously 
estimated various light sources. Based on the reliability, the mixing rate of light sources is 
calculated by an estimated value calculation part 28 and corresponding to the result, white 
balance control is performed while calculating the gain for white balance correction gain control 
to an input image at a gain calculation part 29 so that the optimum white balance control can be 
performed even to the mixed light. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
5 precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 
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[Claim(s)] 

[Claim 1] The color image sensor which carries out image formation of the photographic subject 
image through optical system, and the color separation section which inputs the image pick-up 
signal from said image sensor, and carries out color separation to a fundamental color signal, The 

1 5 color temperature compensation section which input said fundamental color signal and outputs 
by performing gain control [ luminance signal / a primary signal, or / the color difference and a 
luminance signal ] according to the color temperature of the illumination light of a photographic 
subject, The modulation section which connects with the output of said color temperature 
compensation section, and is changed into a composite picture signal, The distance calculation 

20 section between the light sources which finds the distance between each light source on the space 
which inputs said fundamental color signal and consists of this, The color image pick-up 
equipment characterized by to consist of the light source kind presumption section which is 
connected to the output of said distance calculation section between the light sources, and 
presumes a light source kind according to the size of the distance between each light source, and 

25 the color temperature compensation gain value calculation section which generates the gain 

value for performing color temperature compensation, and is outputted to said color temperature 
compensation section from a light source kind presumption section output. 



30 DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to color image pick-up equipments, such as a 
35 video movie. 
[0002] 

[Description of the Prior Art] There is a property of chromatic adaptation in human being's eyes, 
and even if it is under various light sources, the color of the same body is visible to the almost 
same color. However, in a video camera, since it does not have chromatic adaptation nature, 
40 even if it is the same body, color reproduction may differ depending on the class of light source. 
Therefore, to a video camera, automatic white balance amendment is indispensable, and more 
various methods than before are proposed. 

[0003] Here conventional color image pick-up equipment is explained. Conventional color image 
pick-up equipment is explained using drawing 1 and drawing 5 . Drawing 1 is the whole color 
45 image pick-up equipment block diagram, and, for the color separation section and 3, as for white 
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balance operation part and 5, a gain controller and 4 are [ 1 / an image sensor and 2 / a matrix 
and 6 ] encoders. Drawing 5 shows the conventional configuration of the white balance operation 
part 4 in drawing 1 to a detail, and, for average operation part and 12, as for the light source 
selection section and 14, a matrix and 13 are [ 1 1 / memory and 15 ] the gain selection sections. 
5 [0004] About the color image pick-up equipment which consists of such a component, the 
relation and its actuation between components are explained below. First, the picture signal 
acquired by the image sensor 1 is divided into the fundamental color signal of rgb by the color 
separation section 2. And gain control of the rgb signal is carried out by the gain controller 3 
which is the color temperature compensation section, it turns into a r'g'b' signal, and is sent to a 

10 matrix 5. In a matrix 5, r-y and a b-y color-difference signal are generated from the r'g'b' signal 
outputted from the gain controller 3. And this color-difference signal is outputted, after being 
inputted into the encoder 6 which is the modulation section for changing these into a composite 
picture signal and being changed into standard chrominance signals, such as NTSC system, here. 
[0005] Moreover, the chrominance signal rgb outputted from the color separation section 2 is 

15 inputted also into the white balance operation part 4. By the white balance operation part 4, a rgb 
picture signal is first equalized for every screen by the average operation part 11, and it changes 
into color-difference-signal r-y and b-y by the matrix 12, and normalizes with a luminance signal 
Y here. And as the light source selection section 13 shows on a color difference flat surface at 
drawing 4 , the frame determined from the color-difference signal of the various light sources 

20 beforehand memorized in memory 14 is compared with the location of the called-for input 

image, and the light source kind expected that the photographic subject irradiates by whether the 
input image is contained within the limit is chosen. And by . choosing the gain value for 
performing color temperature compensation corresponding to the presumed light source from 
memory 14, and outputting it by the gain selection section 15, the gain of a rgb signal is adjusted 

25 by the gain controller 3, and the white balance of a picture signal is taken. 
[0006] 

[Problem(s) to be Solved by the Invention] However, light source presumption of choosing with 
a configuration one of the light sources currently beforehand prepared on the assumption that it 
says [ that the light source is single in the light source selection section ] was performed 

30 conventionally [ above-mentioned ], and when two or more light sources were irradiated by the 
photographic subject, there was a trouble that it could not ask for the class and mixed rate. 
[0007] This invention solves the above-mentioned conventional trouble, and aims at offering the 
color image pick-up equipment which can presume the class and mixed rate also to the mixed 
light source. 

35 [0008] 

[Means for Solving the Problem] In order to solve the above-mentioned trouble, the color image 
pick-up equipment of this invention The color image sensor which carries out image formation 
of the photographic subject image through optical system, and the color separation section which 
inputs the image pick-up signal from said image sensor, and carries out color separation to a 

40 fundamental color signal, The color temperature compensation section which input said 

fundamental color signal and outputs by performing gain control [ luminance signal / a primary 
signal, or / the color difference and a luminance signal ] according to the color temperature of the 
illumination light of a photographic subject, The modulation section which connects with the 
output of said color temperature compensation section, and is changed into a composite picture 

45 signal, The distance calculation section between the light sources which finds the distance 

between each light source on the space which inputs said fundamental color signal and consists 
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of this, It consists of the light source kind presumption section which is connected to the output 
of said distance calculation section between the light sources, and presumes a light source kind 
according to the size of the distance between each light source, and the color temperature 
compensation gain value calculation section which generates the gain value for performing color 
5 temperature compensation, and is outputted to said color temperature compensation section from 
a light source kind presumption section output. 
[0009] 

[Function] By this configuration, each light source on the space constituted by the fundamental 
color signal and the distance between input images can be found, and it can ask for the rate that 
10 an input image includes each light source by the size of that distance, and can ask for a light 
source class and its mixed rate also from a mixed light. 
[0010] 

[Example] One example of this invention is explained based on a drawing below. First, the 
principle of this invention is explained. When two or more light sources are irradiated to the 

15 photographic subject, in order to ask for the class and mixed ratio, it is effective on a color 

difference flat surface to ask with the distance relation of the location of the light source and the 
location of the actual measurement of incident light which are a candidate for presumed. For 
example, when a mixed light of a halogen lamp and a white fluorescent lamp is irradiated by the 
photographic subject, this mixed light is located between a halogen lamp and a white fluorescent 

20 lamp on a color difference flat surface, and that distance is proportional to the mixed ratio of the 
2 light sources. 

[001 1] Here, when considering the case where a mixed light of the light source A and the light 
source B exists and setting [ a mixed light on a color difference flat surface, and the distance of 
the light source A ] distance of PB, the light source A, and the light source B to P for the distance 
25 of PA, a mixed light, and the light source B like drawing 3 , a mixed light defines reliability SA 
and SB like the following (1) type, respectively as a value showing possibility of including the 
light source A and the light source B. 
[0012] 

SA=1-PA/P (0 <=PA<=P) 
30 SA=0 (PA>P) 

SB=1-PB/P (0 <=PB<=P) 
SB=0(PB>P)~(1) 

If the location of a mixed light laps with the location of the light source A, the mixed light is 
reliability (light source A 100% and light source B0%), and if the location of a mixed light is 
35 located in the middle of the location of the light source A and the light source B, it will serve as 
reliability (light source A50% and light source B50%). 

[0013] In actual incident light, since the class of light source of a mixed light is not known, it 
needs to determine the class. It can ask for this by considering that the light source which is in 
the nearest distance among the light sources which the above-mentioned assumed beforehand to 

40 be the locations of the actual measurement of incident light on the color difference flat surface 
supposing some classes of light source, and the light source near a degree are the light source 
classes of mixed light source. Although the size of the distance of the light source determined the 
light source class since this example was easy, an epilogue, how the size of the distance of that 
direction of a normal determines can be raised in a straight line, and the light sources assumed 

45 beforehand can be chosen as arbitration about that approach. 

[0014] One example of the color image pick-up equipment which realizes the light source 
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presuming method for having used such reliability for below is explained. Drawing 1 is the color 
image pick-up equipment of one example of this invention, and the block diagram showing white 
balance operation part [ in / in especially the whole white balance compensator block diagram 
and drawing 2 / the color image pick-up equipment of one example of this invention ]. In 
5 drawing 2 ? 21 is the block division section. About the average operation part of 22, the matrix of 
23, and the memory of 26, it is the same as the configuration of the conventional example. For 
the distance calculation section between the light sources, and 25, as for the reliability judging 
section and 28, the reliability calculation section and 27 are [ 24 / the estimate calculation section 
and 29 ] the gain calculation sections. 

10 [00 1 5] The relation and its actuation between components are explained below about the color 
image pick-up equipment of this example which consists of such a component. First, after the 
color separation section separates into the fundamental color signal of rgb and gain control of the 
picture signal acquired from the image sensor in drawing 1 is carried out by the gain controller 3 
which is the color temperature compensation section, it is changed and outputted to standard 

15 chrominance signals, such as NTSC system, with the encoder 6 which is the modulation section 
which is changed into r-y and a b-y color-difference signal.by the matrix 5, and changes this into 
a composite picture signal. It is the same as that of the conventional example so far. 
[0016] It explains referring to drawing 2 about white balance operation part here. The 
chrominance signal rgb outputted from the color separation section 3 is divided into some blocks 

20 by the block division section 21 which divides an input image into two or more blocks first. 
Since the processing from here is common to each block, it explains one block. First, rgb each 
data is equalized by the average-value operation part 22, and it is changed into color-difference- 
signal r-y and b-y by the matrix 23, and normalizes with a luminance signal Y. And in the 
distance calculation section 24 between the light sources, distance with the color difference 

25 location to the various light sources beforehand remembered to be the locations of the input 
image called for above on the color difference flat surface in memory 26 is found. 
[0017] And in the reliability calculation section 25, the nearest light source and the light source 
near a degree are chosen, and the reliability as a value showing possibility of including these 
light sources by (1) type based on the distance over them is computed. Thus, although two kinds 

30 of reliability over each light source is searched for at a time for every block, if a chromatic color 
etc. is picturized, the block whose reliability is 0 will arise. Since exact presumption cannot be 
performed if there are many such blocks, if there are many blocks whose reliability is 0 in the 
reliability judging section 27, incorrect presumption will be prevented for light source 
presumption processing only in inside. And if reliability is acquired to some extent, the estimate 

35 U of the light source over an input image will be computed in the estimate calculation section 28. 
When making this into the reliability central value Sn in quest of total of the reliability of each 
block here for every light source, it asks for the rate to the whole light source of the reliability 
central value Sn over each light source, and estimate Un is defined like the following (2) types as 
a mixed rate of as opposed to each light source of an input image for this. 

40 [0018] 

[Equation 1] 



X S . 

[0019] The above-mentioned reliability calculation section 25, the reliability judging section 27, 
45 and the decision value calculation section 28 constitute the light source kind presumption section 
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which presumes a light source kind according to the size of the distance between each light 
source. Thus, since the class and its mixed rate of the light source over an input image were 
called for by the light source kind presumption section, next the gain calculation section 29 
performs gain calculation for white balance amendment gain control to an input image, and the 
5 gain controller 3 performs white balance amendment. That is, the gain calculation section 29 
generates the gain value for performing color temperature compensation from the output from 
the estimate calculation section 28 which is the output of the light source kind presumption 
section, and operates as the color temperature compensation gain value calculation section which 
outputs this to the gain controller 3 which is the color temperature compensation section. 

1 0 [0020] In addition, although there are an approach by fuzzy control, an approach by the neural 
network work system, etc. about the gain computing method, this example may use any 
approach. Moreover, although the image sensor was made into one piece, the color separation 
section separated into the fundamental color signal and light source presumption was performed 
in this example, the same effectiveness is acquired even if it is the things equipped with two or 

15 more image sensors (2 plate type, 3 plate type camera, etc.). Moreover, if light source 

presumption is not performed on the color difference flat surface usual by detecting three kinds 
of the bright-line-spectrum components and infrared components of a fluorescent lamp without a 
fundamental color signal to light source presumption by forming an image sensor independently 
but light source presumption is performed more in the space of high order origin, the light source 

20 presumption error over a mixed light can be decreased more. 
[0021] 

[Effect of the Invention] As mentioned above, according to this invention, by introducing the 
reliability based on the distance between each light source on a color difference flat surface, it 
can ask for the class and its mixed rate of the light source from an input image, and highly 
25 precise light source presumption can be realized. Thereby, minimization of a color temperature 
compensation error can be attained. Therefore, improvement in the color reproduction nature of 
the video camera under various light sources is achieved, and the effectiveness is large. 



30 DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

fDrawing 11 The whole color image pick-up equipment block diagram of one example of this 
invention • 

35 [Drawing 2] The block diagram showing the white balance operation part in the color image 
pick-up equipment of one example of this invention 

fDrawing 31 Drawing explaining the reliability space in the color image pick-up equipment of 
one example of this invention 

rDrawing 41 Drawing explaining the light source selection block in conventional color image 
40 pick-up equipment 

[Drawing 5] The detail block diagram of the white balance operation part in conventional color 

image pick-up equipment 

[Description of Notations] 

1 Image Sensor 
45 2 Color Separation Section 

3 Gain Controller 
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4 White Balance Operation Part 

5 Matrix 

6 Encoder 

21 Block Division Section 
5 22 Average Operation Part 

23 Matrix 

24 Distance Calculation Section 

25 Reliance Section Calculation Section 

26 Memory 

1 0 27 Reliability Judging Section 

28 Estimate Calculation Section 

29 Gain Calculation Section 
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[Drawing 2] 
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[Drawing 5] 
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